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Abstract 



A nonlinear operator equation F(x) — 0, F : H — > iJ, in a Hilbert space is considered. 
Continuous Newton's-type procedures based on a construction of a dynamical system with the 
trajectory starting at some initial point xq and becoming asymptotically close to a solution 
of F(x) = as t — > +oo are discussed. Well-posed and ill-posed problems are investigated. 
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in a real Hilbert space H. We consider a real Hilbert space for the sake of simplicity: 
numerical algorithms for solving in a complex Hilbert space can be treated similarly. 
In order to approximate a solution to equation we use the idea developed in 0-0], 

which consists of constructing a dynamical system with the trajectory starting at some 
initial point xo and converging to a solution of (| 1 - 1|> as t — > +oo. This idea, in its simplest 
form goes back to A.Cauchy (steepest descent) and was proposed in jS] for solving some 
optimization problems by a continuous analog of the gradient method. In || a wide class of 
linear ill-posed problems was studied by the dynamical systems method. In [H] a continuous 
Newton's scheme 



1. Introduction 



The theme of this paper is solving nonlinear operator equations of the form: 



(1.1) 



F(x) = 0, F :H -> H } 



(1.2) 



x(t) 



[F'^t))]- 1 ^*)), x(0) =x eH, 
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was studied and a theorem establishing convergence with the exponential rate was proved. 
A modified continuous Newton's method is proposed in [Q: 

(1.3) x(t) = -J(t)F(x(t)), x(0) = x Q eH, J(0) € L(H), 

(1.4) J(t) = -v[F>*( x (t))F>(x(t))J(t) + J(t)F'(x(t))F'*(x(t))] + 2»F'*(x(t)), 

where /i is a positive constant. System i|1.3fl - l|1.4|) avoids the inversion of the Frechet deriv- 
ative F'(x), which is numerically difficult in some applications. 

The regularized Gauss-Newton's-type algorithm with simultaneous updates of the oper- 
ator \F'*{x{t))F'{x{t)) + sit)!}- 1 was proposed in 

(1.5) x(t) = -D(t) [F'*(x(t))F(x(t)) + e(t)(x(t) - x )] , 

(1.6) D(t) = -[(F'*(x(t))F'(x(t))+e(t)I)D(t)-l], 
x{0)=x £H, D(0)eL{H), 0<e(i)^0 as t -> +oo. 

It is shown that x(t) converges to a solution of i|l.lfl at the rate 0(e(t)). The convergence 
theorem is proved without assuming monotonicity of F and bounded invertibility of F'{x). 

In and 0] a fairly general approach to the analysis of continuous procedures in a Hilbert 
space was developed. According to this approach one investigates a solution to the Cauchy 
problem for a nonlinear operator-differential equation by using differential inequalities. In 
the well-posed case (the Frechet derivative operator F'(x) is boundedly invertible in a ball, 
which contains one of the solutions) one investigates the Cauchy problem for an autonomous 
equation: 

(1.7) x(t) = *(aj(t)), x(0) = a*. 

The choice of $ : H — > H yields a corresponding continuous process. In the ill-posed case 
(F'(x) has a nontrivial null-space at the solution (|1.1|) or is not boundedly invertible) a 
regularized continuous procedure is required. For this reason the Cauchy problem for the 
following equation is to be analyzed: 

(1.8) x(t) = $(«(*),*), x(0)=xq, 
with $ : H x [0, +oo) — > H. If one takes 

$(h, t) := -[F'(h) + e(t)]- 1 (F(/ l ) + e(t)(h - x )), 

then one arrives at a continuously regularized Newton's scheme (CRNS). The convergence 
analysis of CRNS is done in |2j under the assumption that F'(x) > as an operator in H . 
For 

$(M) := —[F'*(h)F'(h) + e(t)]- 1 (F'*(/ l )F(ft) + e(t)(h - x j) 
one obtains continuously regularized Gauss-Newton's scheme (CRGNS). The convergence 
theorems for CRGNS (see [2] and 0) do not use any assumption about the location of 
the spectrum of F'[x). The absence of such assumption is made possible by source- type 
conditions. 

In section 2 of our paper we study a continuous analog of a modified Newton's method: 

(1.9) x(t) = -[F'(x )]- 1 F(x(t)) ) x(0) = x E H, 

for solving well-posed nonlinear operator equation p. 1(1 . Theorem 12.31 establishes expo- 
nential convergence of l|1.9f) to a solution of i|l.l|). Process l|1.9|) can be used in practical 
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computations when calculating and inverting of F'{x) at each moment of time require a 
considerable effort. Another continuous algorithm, investigated in section 2: 

(f.10) x(t) = -B(t)F(x(t)), x(0) = x eH, B(0) = B Q e L{H), 

(1.11) B(t) = -F'*(x(t))F'(x(t))B(t) + F'*(x(t)), 

can also be recommended in the above situation. It allows one to update [F^rr)] -1 contin- 
uously for t e [0, +oo) without actual inversion of the Frechet derivative. In Theorem 12.61 
the exponential convergence of ll.10fl - ll.llfl to a solution of (1.1) is proved. 

For many important inverse problems of the form (|l.lfl the operator F'{x) is not bound- 
edly invertible. For such problems the regularized version of algorithm (|1.9|) is suggested in 
section 3 

(1.12) x(t) = -[F'(x ) +e{t)I]- 1 (F(x(t)) + e(t){x(t) -x )), x{0) = x G H, e(t) > 0. 

The convergence analysis of continuous regularized method H1.12JI is done in Theorem 13.11 
under the following assumption: 

(1.13) F'(x) = F'(x )G(x ,x), 
where 

(1.14) \\G(x ,x)-I\\<C(G)\\x Q -x\\, x ,x£U(p,x), 

and x is a solution to (|1 . 1|) . Assumption p. 13(1 - p. 14(1 is similar to condition (8) in [7j. It 

means that the operator F'(x) remains in principle the same for all a; in a neighborhood of a 
solution up to some modification by a linear operator G(xo, x). The reader may consult |Zj 
for several examples of nonlinear inverse problems for which condition 1(1.13(1 - 11.1411 can be 
verified. As a consequence of Theorem 13. II we obtain the stability of process ((1.12(1 towards 
noise in the data and choose an optimal regularization parameter (the stopping time) such 
that the method converges to a solution of ((1.1|) when the noise level tends to zero. 
Our main motivations for this investigation are: 

1) We think that the dsm (dynamical systems method) that we develop in this paper 
(and in the earlier publications, cited in the references) is not only of theoretical interest, but 
also provide a powerful numerical tool for solving very wide variety of problems, namely all 
the problems which can be described by equation (1.1) with the nonlinearity satifying the 
assumptions of our theorems formulated in Sections 2 and 3. 

2) We think that the idea of constructing a method for solving equation (1.1) which does 
not require inverting F'(u) (see, for example, equations (2.21) and (2.22) below) is of both 
theoretical and practical interest even for well-posed problems. 

3) The dsm gives a general approach to constructing convergent iterative methods for 
solving ill-posed nonlinear problems. We do not address this part of the dsm in our present 
paper, but it has been addressed in detail in [4]. 

Finally we note that the dsm was tested numerically (see [2], [3], [10] for example), but it 
certainly of interest to study much more the numerical performance of dsm. In this paper, 
however, the authors deal with the theoretical questions. 

2. Continuous modified Newton's schemes for well-posed problems 

In this section we solve nonlinear operator equation ((1.1|) under the assumption that the 
Frechet derivative of the operator F is boundedly invertible in a ball which contains one 
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of the solutions. Let xq be an initial approximation for a solution to (|1 . lj) and x(t) be a 
trajectory of the autonomous dynamical system 

(2.1) x(t) = $(x(t)), 0<i<+oo, x(0)=x . 

Lemma 12.11 below (see 0]) gives simple sufficient conditions on nonlinear operators F in 
(11.1(1 and $ in ((2.1(1 which guarantee that: 

(a) initial value problem ((2.1(1 is uniquely solvable for all t G [0, +oo); 

(b) the solution x(t) tends to one of the solutions of 1(1.1(1 as t — > +oo. 

Lemma 2.1. Let H be a real Hilbert space, F, $ : H — > ff. 

Suppose that there exist some positive numbers c\ and ci such that F and $ are Frechet 
differentiable in U(r,Xo) :— {x G H, \\x — xq\\ < r} } r := S^iLS^glU anrf Vft G U(r,Xo) the 
following conditions hold 

(2.2) (F'(h)<f(h)),F(h))<-ci\\F(h)\\ 2 , 
and 

(2.3) ||$W||<c 2 ||^)l|. 
Then: 

1. there exists a global solution x — x(t) to problem $2.1Jjl in the ball U(r,Xo); 

2. there exists 

(2.4) lim x(t) = x, 

t — >+oo 

where x is a solution to in U(r,Xo), and 

(2.5) \\x{t)-x\\<re' Cl \ 



(2.6) ||F(^))||<imx )||e- Clt . 

Proof. From the Frechet differentiability of $ the local existence of a solution to ((2.1|) 
follows, and from 1(2.1(1 one gets: 

(2.7) j t [F{xm = = nxiwi*®)- 

Let X(t) := F(x(t)). Then 

(2.8) A(t) = F'(x(t)Mx(t)), A(0) = F(x ). 

At least for sufficiently small t, for which x(t) G U(r,xo), one can use estimate 1(2.2(1 and 
get: 

(2-9) 7^H A WH 2 = (*(*), A(t)) = (i^t))^*)), W))) < - Cl ||A(i)|| 2 . 
Thus, at least for sufficiently small t > 0, one gets: 
(2.10) ||A(t)||<||f(x )||e-^. 
For < ti < i 2 by (JOJ) one has 



||ar(* 2 ) — 5c(ti)M < 



x(s)ds 



< [ 2 \Mx( s ))\\ds < c 2 f 2 ||A(*)||ds 

Jtl Jtl 



c 2 \\F(x )\\ 



Cl 



(2 n) < c 2 ||F(z )|| (e-d*! _ e -c lt2 ) < ^Mlle-dtx. 

Cl Ci 

Setting t\ = and £2 = ^ one concludes from 1)2.11)1 that a;(t) S ?7(r, xq) with r 
whenever it is defined. Therefore the standard argument yields existence and uniqueness 
of a solution to 1)2.1)1 on [0, +00). Now let in 1)2.11)1 t\=t and £2 — * +00 . Then one gets 
1)2.5)1 . and the limit i in 1)2. 4|l does exist due to (|2.11(l . From 1)2.10)1 one concludes that x is 
a solution to 1)1.1)1 . Inequality 1)2.6)1 follows from 1)2.10)1 . Lemma 2.1 is proved. □ 

Remark 2.2. Assumptions of Theorem \2.3\ do not imply uniqueness of a solution to equation 
i)j.i)) . If is not uniquely solvable then x(t) converges to one of its solutions in U(r,xo)- 
In Lemma 2.1 we have assumed that c\ and ci are some known constants in the ball 
U(r,xo), and this assumption allowed us to define r explicitly in terms of the ratio ^ and 
||-F(xo)||. One may assume that — is not a constant but a function of r , ^ := c(r). In this 
case , in order that the argument of Lemma 2. 1 be valid, one has to satisfy the inequality 
c(r)\\F(xo)\\ < r. For example, if — > as r — > oo, then there always exists an r > 
such that the conclusion of Lemma 2. 1 holds and the assumptions of this lemma are satisfied 
in the ball U(r,Xo). 

Now consider the following continuous modified Newton's scheme: 

(2.12) x(t) - -[F'^o)]- 1 ^*)), x(0) =x eH. 

Theorem 12 . 31 below establishes a relation between the asymptotic behavior of a solution x{t) 
to 1)2.12)1 and solutions to equation 1)1.1)1 . It is a consequence of Lemma \'2. II 

Theorem 2.3. Let H be a real Hilbert space, F : H — > H . Assume that F is Frechet 
differentiable, its Frechet derivative F' is Lipschitz- continuous: 

(2.13) ||F'(a;i)-F'(x2)||<M2||ari-X2|| Vxi, x 2 G U(f , x ), 
where 

(2.14) U(r,x ):={xeH, \\x-x \\<f}, f := — , mi := \\[F' {x^W, 
and 

(2.15) 4M 2 m2||F(x )|| < 1. 
Then 

1. There exists a unique solution x = x(t), t £ [0, +00), to problem \2.12)) . 

2. x{t) e U(f,x ) Vt E [0, +00), and 

(2.16) lim x{t) = x, 

t — >+oo 

where x is a solution to 

3. The following estimates hold: 

(2.17) Mt)-x\\ < 2TOi||F(a; )|| e -t, 

(2.18) \\F(x(t))\\<\\F{x )\\e-l 
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Proof. Take 

(2.19) *(x(t)):=-[F'(x )]- 1 Fix{t)). 

Then, under assumptions l|2.13ll and (|2.14|) of Theorem 12. 31 one gets V/i G U(f, Xq) 

(F'(h)<S>(h),F(h)) = -(F'ih^F'ixoT'F^Fih)) = -\\F(h)\\ 2 
+ ({/-F'(/^'(z )r 1 }i^)^ 

(2.20) <-\\F(h)\\ 2 + M 2mi r\\F(h)\\ 2 = ~\\F(h)\f. 

Also one has ||$(/i)|| < mi\\F(h)\\. Thus conditions (|2~2^l and itO) of Lemma IO hold for 
any h £ U(r,x ) with $ defined in l|2.19|l . C\ = | and c 2 = m±. Hence r :— £ai£fegli! = 
2toi||F(x )||. From (|2~TI|) and i(2~T5|) one has 2mi||F(x )|| < 2M * mi := f. Therefore (|2~21) 
and l|2.3|) are satisfied on U{r, xo), r := C2 '\ F J^°>\\ ; ci = |, C2 = mi. Applying Lemma |2~T1 
one completes the proof. □ 

Remark 2.4. (a) Choosing &(h) = — [F'(h)]~ 1 F(h) one gets Continuous Newton's method. 
In this case C\ = 1, c 2 = /ii := sup x£t/ ( r x n ||[F'(ie)] _1 ||, and Lemma \2. 1\ uields the conver- 
gence theorem for Continuous Newton's method [Jj]. 

(b) Choosing &(h) = —F(h), one gets a simple iteration method, for which condition \2.2}) 
means strict monotonicity of F: F' > c± > 0, and c 2 = 1. 

(c) = — [F'(h)]*F(h) corresponds to the gradient method. 
Here c 2 = Mi := sup xef7 ( rja . ) and C\ = /x7 X . 

(d) $(/l) = ~[F'* (h)F' '{h)]- 1 F'* (h)F(h) yields Continuous Gauss- Newton's scheme. Here 
ci = 1, c 2 = /ii-Mi, where \i\ is the same as in (a) above, and M\ is the same as in (c) 
above. 

In order to avoid inversion of the Frcchet derivative F'(x(t)) even at the initial moment 
t = 0, one can consider the following algorithm, which is a Cauchy problem for a system of 
two equations: 

(2.21) x(t) = -B(t)F(x(t)), x(0) = x (EH, 5(0) = B e L{H), 



(2.22) B(t) = -F'*(x(t))F'(x(t))B(t) + F'*(x(t)). 

Equation (2.22) is similar to equation (1.3) in [3]. To prove Theorem 12.61 below we use 
the following lemma, which is an operator-theoretical version of the Gronwall inequality: 

Lemma 2.5. Let 

(2.23) ^+A(t)V(t)=G(t), V(0) = V , 

where A(t), G(t), V(t) € L(H), L(H) is the set of linear bounded operators on H, and H is 
a real Hilbert space. If there exists a scalar function £(t) > 0, £ 6 Lj oc (0, oo), such that 

(2.24) (A(t)h,h) > C{t)\\h\\ 2 V/ieiJ, 



then 



(2.25) 



\\V(t)\\<e I 



f (( P )dp 

\\G(s)\\e° ds+\\V(0)\\ 
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Proof, (see jHJ) Take any h € H. Since H is a real Hilbert space one has: 

= -(A(t)V(t)h,V(t)h) + (G(t)h,V(t)h) 

(2.26) <-C(t)||^)/,|| 2 + ||G(;)|| \\h\\ \\V(t)h\\ 
Denote v(t) := ||V(i)ft||. Inequality (t2~2l)j) implies 

(2.27) w<-C(^ 2 + ||G(t)|| 

Divide this inequality by the nonnegative v and get a linear first-order differential inequality 
from which one gets i|2.25[l . Lemma 12.51 is proved. □ 

Theorem 2.6. Let H be a real Hilbert space, F : H — > H. Assume that: 

1. U{R,Xq) :— {x G H, \\x — xq\\ < the operator F is twice Frechet differentiable, F'(x) 

is boundedly invertible, and 

(2.28) IIF'^H <Mi, ||F"(a:)|| < M 2 , 1 1 [J^'C^)] 1 1 1 ^ < J V.t G t/(i?, z ), 
w/iere 

f9 9(rt R 7C l-HF^Bo-Jll ^ M 1^|| R || 
2.29 := 7:= >0, cr := + -Bo - 

2MlM2<T 2 c 

I?. Equation 11. 1\) is solvable in U(R,xq) (not necessarily uniquely), and x is a solution. 
3. F(xq) satisfies the following condition 

(2M 1 M 2 ,,, , Nll ] 1/2 

(2.30) |_^.||, (a ,)||j <7- 

Then: 

1. there exists a unique solution (x(t), B(t)), t G [0, +00), to problem \2.21\) ~ y2.22\) : 

2. x(t) G U(R,x Q ) Vt G [0,+oo); 
5. the following estimates hold 

(2.31) ll^-^I^^Mie-^ 



(2.32) \\F(x(t))\\<\\F(x )\\e-^, 

(2.33) ||^(x(t)) J B(t)-/||<(M 2 ||^(x )|| ( 7 2 i+||^'( a ;o) J Bo-/||)e- ct , if c = 7, 
(2.34) 
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Proof. Under the assumptions of theorem 2.6 there exists a unique solution (x(t), B(t)) to 
(|2.21JI - H2.22|I on some interval [0, r], and, at least for sufficiently small t > 0, x(t) € C/(i?, Xo). 
Since Vx £ Z7(J2, xo) and Vh <E H 

(2.35) (F ' (x) ^ (x)/l ,/ l )>__l__ ||/ l || 2 > c ||/ l || 2 , 

by H2.22f> and Lemma f2. 51 one gets 



||F'*(x(s))||e cs ds + \\B(0)\ 



11^)11 <e" ct 
Thus by lj!T2g)l and QTZfy 

(2.36) ||S(t)|| < ^ (1 - e- ct ) + ||i?o||e- ct < ^ + ||Bo|| := * 

Let us analyze the initial value problem for w(t) :— F(x(t)). One has 
w(t) = F'(x(t))x(t) = -F'{x(t))B(t)w(t). 

Therefore 

(2.37) w(t)+w(i) + [F'(x(t))B(t) -I]w(i) = 0, w(0) = F(x ). 
Denote := F'(x(t))B(t) - I. Then 

W(t) = F"{x{t))x{t)B{t) + F'(x(t))B(t) 
= -F"(x(t))B(t)F(x(t))B(t) +F'(x(t))[-F'*(x(t))F'(x(t))B(t) +F'*(x(t))} 
= -F"(x(t))B(t)F(x(t))B(t) - F'(x(t))F'*(x(t))W(t). 
Consider the problem 

(2.38) W(t) + F'{x(t))F'* (x(t))W(t) = -F" (x(t))B(t)F(x(t))B(t), 

(2.39) W(0)=F'(x o )B(Q)-I. 

From (|2.35|) . I|2.38|l - H2.39|l and Lemma \l. 51 one obtains the estimate 



(2.40) ||W(t)||<e- 



t 

hi 



o 



\F"(x{s))B{s)F{x{s))B{s)\\e cs ds + \\W(0)\\ 

Assumptions 1 and 2 of Theorem 12.61 yield 

\\F(x(t))\\ < \\F(x(t)) - F(x )\\ + \\F(x ) - F(x)\\ < 2M 1 R 
for all values of t such that x(t) e U(R,xq), 



Thus: 

< ~ I ^ + ||B(0)|| ) + ||^(0)|| = " , || lr , (n = -, + ||n-(()i| 



2M 1 M 2 RfM 1 ..^^.A 2 ,„„,„,„ 2M 1 M 2 Ra z 



Hence one gets from 
(2.41) || WW ||<idM + | W0) ||_i±ra. 

Now one has the following differential inequality 

ljt Mm2 = - ||w(<)1 ' 2 - < - 1 ~ ll f (0)ll |Kt)H 2 = -j\Mt)\\ 2 
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Therefore 

(2.42) \\w(t)\\ < \\w(0)\\ e" 7 * 

for all values of t, such that x(t) G U(R,xq). If < t\ < t 2 , one obtains 





pt2 




< 


/ x(s) ds 











\\x(t 2 ) - xit^W < 



(2.43) < amXo)l 



'Mi 



12 



115(0)11 |K*)||ds 



ti 



7 

From (|2~4lfl) by conditions (|2~2gi) and lf!T3T)j) one gets: 
(2.44) 

iw« - i(<i)|1 s 2MiM2 ; 3 F (1 °'" - s « - ■ 

Since B(t) is bounded whenever it is defined, estimate (|2.44|l implies that there exists a 
unique solution (x{t),B(t)) to fFF^ - fTZty on [0,+oo) and Vi £ [0, +oo) ar(i) G U(R,x ). 
Setting ti — t and £2 — * +oo in 12.4311 one gets l|2.31|) . Inequality (|2.32l) now follows from 
(E32>. Let us go back to 12.4011 . By 12.42fl one has 

ft 



(2.45) \\W(t)\\<e 



-ct 



\F"(x( S ))\\\\B( S )\\ 2 \\F(x )\\e^>ds+\\W(0)\ 



Estimate (|2.45|) implies (|2.33[1 - (|2.34[1 . This completes the proof. □ 

3. Ill-posed case. Continuously regularized modified Newton's scheme 

In many important applications the Frechet derivative operator is not boundedly invert- 
ible, i.e. the problem is ill-posed. To overcome this difficulty we suggest a regularized version 
of algorithm l|2.12|) : 

(3.1) x(t) = -[F'(x Q )+s(t)I]- 1 (F(x(t))+£(t){x(t)-xo)), x(0)=i„eff, < e(t), 

where Xq is chosen so that (F'(xo)h, ft) > Vft S H. If such a choice is not possible for the 
original equation F(x) = 0, one may consider an auxiliary problem 4>{x) := F'*{xq)F{x) = 0. 
If F is Frechet differentiable, one has <p'(x ) = F'*(x )F'(x ) and (0'(£c o ))ft, ft) > Vft G iT. 
The last equation, in general, is not equivalent to However every solution to 

solves <fi(x) = 0. The convergence analysis of (|3.1|l is done in the following theorem. 

Theorem 3.1. Let H be a real Hilbert space, F : H — > H, equation \1.1)) be solvable (not 
necessarily uniquely), and x be a solution to (1.1). Assume that: 

1. A positive junction e{t) G C^O, +oo) converges monotonically to zero as t — > -\-oo, 
is nondecreasing, and e(0) > |e(0)|. 

2. F is Frechet differentiable, its Frechet derivative F' is Lip schitz- continuous: 

(3.2) \\F'(x 1 )~F'{x 2 )\\<M 2 \\x 1 ~X2\\ and F'(x) = F'(x )G(x Q , x), 
where 

(3.3) G(xo,x) G L(H), \\G(xo,x)-I\\<C(G)\\x -x\\, Vrci, x 2 , x G U(p,x), 

e(0)-|e(0)| 



(3.4) U(p,x):={xGH: \\x-x\\<p}, C{G) > 0, p := 



M 2 + C(G)e(0) ■ 
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3. F'{xq) is non-negative definite: 

(3.5) {F'{x )h, h) > VheH, ||x -x||<p. 

4- There exist v G H such that x — xq — F'(xq)v, 



I2\\v\ 



(3.6) £ (0) - |e(0)| > [M 2 + C(G) £ (0)] £ (0)^ . / _ . 

Then a unique solution x = x(t) to problem \3. 1\) exists for all t G [0, +oo) and 
(3 7) \\x(t) - x\\ < £{0) ~ mi s(t) 

Remark 3.2. Inequality \3. b}) can always be satisfied if 
yj2\\v\\M2 < 1 ■ Indeed, inequality \3. 6)) is equivalent to 



(3.8) 1 - V2|R^2 > M + £ (0)C(G) J^M. 

Thus, if ^/2\\v\\M2 < 1, i/ien inequality holds if and e(0) are sufficiently small. 

For e(t) = oe" w , a, 6 > 0, inequality i)#.6|) Zio/ds i/ i/ie following inequality is valid: 



l2\\v\\ 



6 + aC(G)y-^i <l-v/%p2. 

T/ie foregoing inequality holds if a and b are positive and sufficiently small and 1 > y^j]w[|M2. 
Since a priori \\v\\ is not known, in the numerical applications of the scheme one has to try 
different functions e(t) for \3. (>)) to be fulfilled. 

Remark 3.3. Consider nonlinear integral equation of the first kind: 

(3.9) F(x) := ip(x) - y = 0, i/)(x)(t) := [ k(t, s)g(s,x(s)) ds, te[0,l], 



where k(t,s) G L°°((0, l) 2 ) and g(s,u) is twice continuously differ entiable with respect to u 
onO < s,t < 1, -oo < u < +oo. Suppose F : H 1 ^,!] -> L 2 (0,1). Then 

(F'(x)h)(t)= [ k(t,s)g x (s,x{s))h(s)ds. 



Introduce the nonlinear operator 4>{x) :— F' * (xq)F(x) , <fi : H 1 ^, 1] — > -ff^O, 1], and sofce the 
equation <p(x) = 0. Clearly (f>'(xo) is non-negative definite, i.e. condition 3 of Theorem \3.1\ 
holds. Under the additional assumptions \g x (s, Xq)\ > k > for any s G (0, 1), and g(s, u) G 
C 3 ((0, 1) x (— oo, +oo)), one can take (G(xo, x)h)(s) :— g*(sxo(l)) * n or ^ er ^° satisfy 
condition 2 of Theorem \3.1\ Indeed, 



(<f>'(x)h)(t) = (<t>'(x )G(x ,x)h)(t), 
and for any h G H the following estimates are used in [7]: 

2 

ds 



\\(G(x ,x)-I)h\\ L 2 = 



Jo 9xx{s, (xo + 0(x - x ))(s)) d9(x(s) - x (s))h(s) 



g x (s,x (s)) 
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, II || ||, || 

< \\x-x \\l^ \\h \\ L 2. 



Also \\£(G(x ,x) - I)h\\ L2 

Jo 9sxx(s, (x + 9(x - x ))(s)) + g xxx (s, (x + 9(x - x a )){s))(x' + 9(x' - x' o ))(s)d0 



(x(s) - x (s))h(s) 

1/2 







[l 


[( 



g x (s,x (s)) 

Jo 9xx(s, (x + 9{x - x ))(s)) dO{g sx (s, x(s)) + g xx (s, x(s))x'(s)) 

gl(s,x (s)) 



Io9^o^9( x x 0)K s ))d 9 + 
g x {s,x (s)) 



ds 



< If - xo\\L°°\\n\\L 2 -\ 7, If -io z,» f I» 

K 6K 

\\g xx \\L°°\\gsx\\L<=° |, I, |,,,| IIS'xx|||oo||a; / || L 2 
H 5 F - zo U°° K 1 l 2 "I 5 If - 10 1" « L» 

' " ' ^ (I \ X ' - X' Q I \ L 2 \\h\\ L - + \\X - X \ |i- I | L 2 ). 



T/ie L°°(0, l)-norms of x — and /i can 6e estimated by their -ff^O, l]-norms times some 
constants, due to Sobolev's embedding theorems. 

Thus if one assumes that equation yd.i^l is solvable, x is its solution, and in a neighborhood 
of x there exists Xq such that 

x-x = (t>'{x )v, y/2\\v\\M 2 < 1, 

then a unique solution x = x(t) to the problem 

x(t) = -[4>'(x ) + + *(*)(&(*) ~ x o)), x(0) =x eH, < e(t), 

exists for all t G [0, +oo) and 

\\x(t)-x\\ = 0(e(t)), 

provided that the above assumptions on k(t,s) and g(s,u) are satisfied and the choice of s(t) 
is made according to $3.8p with being nondecr easing. 

Proof of Theorem 3.1 First, from l|3.5[) one concludes that the operator [F'(xo) + 
e(i)/] -1 is bounded Vt > 0. Let us show that if x = x(t) solves (|3.1|) . then x(t) G U(p,x) 
with p introduced in (|3.4(1 . Assume the converse: there exists T > such that 

(3.10) \\x(t)-x\\<p Vie[0,T) and \x(T) - x \ \ = p. 

For any t G [0, T] one has 

I_||a;( t )_i||2 = -([ J F'( a ; ) +E ( i )/]- 1 [F , (^)( : r(t)-£)+ J R 2 (a ; (t),x)+e(t)(a ; (t)-a ; o)],a ; (0-^), 
where \\R 2 (x(t),x)\\ < *f-\\x(t) - x\\ 2 . Thus one gets 

\j t \W) " ill 2 < ~\W) " ill 2 " (lF'(x ) + e(t)ir\F\x) - F'(x ))(x(t) - x), x{t) x) 
~e(t)([F'(x ) + sit)!}- 1 ^ xo), x(t) - x) + ^ylW*) - *|| 3 . 
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Condition 2 of Theorem IO and the estimate ||[F'(x ) + s{t)I]~ 1 F'(x )\\ < 1 yield 
\j t \W) " ill 2 < ~Mt) ~ ill 2 + \\G(x ,x) - I\\ \\x(t) - .i|| 2 + s(t)\\v\\ \\x(t) - x\\ 

+ ^lkW-i|| 3 <-(l-C(GV)||xW-i|| 2 + £ (t)|| W ||||x(i)-i|| 

(3.H) + ^7) Mt) ~^ 3 - 

Introduce the notation Q(t) := \ \x(t) — x\\. Inequality (|3.11|) implies 

(3.12) Q( t )<-(l-C(G)p)Q(t)+s(t)\\v\\ + ^-Q 2 (t), Q(0) = \\x - x\\. 

Take f(t) = j^y- By assumption 1 of Theorem 13 . II one obtains: 

(3-13) m<-(l-C(G)p-^)f(t) + \\v\\ + ^f(t), /(Q)- 11 '" 



e(0) J J w 2 J w ' J w e(0) 
From (|3.4() and (|3.13|l one concludes that 

(3-14) /(^- .ff'f'-'f'L jW + IMI + ^J'W. /(0)- 11 *""* 1 



e(0)[M 2 + C7(G)e(0)]' w 2 J w ' J w e(0) ' 
Let 

^i^ M2 M 2 ( £ (0)-|e(0)|) 

(3 - 15) Ci:= — ' C2:= £ (0)[M 2 + C(G) g (0)] ' C3:=IW| - 

If g(t) is a solution to the initial value problem 

(3.16) g(t)=C ig 2 (t)~C 2 g(t) + C 3 , 

(3-17) .9(0) = /(0), 

then inequality (|3.14|) yields 

(3.18) f(t)<g(t), 

whenever g(t) and f(t) are both defined. By 13. 4|) . I|3.5|l and l|3.15l) one has 

mqi frm- r 9 - £ (°)-l^ )l - ° 2 

1 ' ' J[ ' e(0) e(0) e(0)[Af 2 + C(G)e(0)] 2C*i ' 

By H3.6|l the equation Gig 2 — G 2 </ + G3 = has at least one real root. If there are two roots, 
the smaller root is a stable equilibrium for problem H3.16JI . which implies g(t) < g(Q) — 
/(0) < Otherwise g := is a solution to (fXlTty. and g(i) < since g(0) < 

Therefore from (|3.18(l and (|3.19|l one derives: 

Hence inequality Ij3.14|) and conditions (|3.4(l and (|3.6|l yield: 

e(0)-|e(0)| _ p 



(3.20) f(t) < 



e(0)[M 2 + G(G)e(0)] e(0)' 
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Thus 

(3.21) \\ x ( t )-£\\ < P e (j t )<p Vt£[0,T], 

which contradicts H3.10|) . Therefore x(t) £ U(x,p) for any t, and by the standard argument 
one concludes that x(t) is defined on [0, +oo). Inequality l|3.7|l follows from Ij3.4|l and l|3.21j) . 

□ 

Corollary 3.4. In this corollary it is shown that if the data are noisy, then the stopping 
time can be chosen so that the solution to the Cauchy problem with noisy data approximates 
a solution to stably, i.e. with the error going to zero as the noise level goes to zero. 

Let the operator F in have the following form 

(3.22) F(x):=iP(x)-y. 

Assume that tj) is given exactly and in place of y we know a 5 -approximation ys, satisfying 
the inequality 

(3.23) ||y-w||<*. 

Then 

lj t Mt) " ill 2 < -(1 - C(G)p)\\x{t) - i|| 2 + ( e (t)||t;|| + \\x(t) x\\ 

(3-24) +_^|| a; ( t )_ i ||3. 

1 

Take t$ such that s(ts) — fjjfyjj ' ^ or ^ ~ Ts we e' 1 (t 5 ) = IN I an< ^ therefore Vt G [0, rj] 
(3-25) /(*)<- (l - C{G)p- Ml) m + 2\\v\\ + ^lf\t), /(0)- H-''""-'' 



e(0) J w " " 2 J w ' J w e(0) 



Thus one gets 
(3.26) 

provided that conditions 1, 2, 3 of Theorem \3.1\ and inequality 



(3-26) \\x{r s )-x\\< P dK 

e(0) \\v h 



(3.27) E (0) - |e(0)| > 2[M 2 + C(G) e (0)] e (0)W M 
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